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Abstract 


This  paper  describes  a  class  of  convex  programs  with  tree  constraints  that 
has  applications  in  production  planning,  capacity  expansion,  and  other 
related  areas.  A  reduction  procedure  is  presented  for  solving  this  class  of 
convex  programs  with  N  variables.  This  reduction  procedure  determines  an 
optimal  solution  to  the  convex  problem  by  solving  at  most  N  simple  convex 
subproblems.  Hence,  this  reduction  procedure  is  an  efficient  approach  for 
solving  large  scale  convex  programs  of  this  sort.  (VO  £ _ 


1.  Introduction 


Consider  a  directed  tree  T  that  consists  of  a  set  of  nodes  N  and  a  set  of 
directed  arcs  E,  where  E  is  a  subset  of  NxN.  For  each  arc  (j,i)  €  E  that 
emanates  from  node  j  and  terminates  at  node  i,  node  j  is  an  immediate 
predecessor  of  node  i  and  node  i  is  an  immediate  successor  of  node  j.  Hence, 
the  root  node  of  T  has  no  immediate  successor  and  each  terminal  node  of  T  has 
no  immediate  predecessor.  For  each  node  i  that  is  not  the  root  node  nor  a 
terminal  node,  node  i  has  exactly  one  immediate  successor  S(i)  and  a  set  of 
immediate  predecessors  P(i)  such  that  (j,i)  e  E  for  each  j  e  P(i) .  Each  node 
i  is  associated  with  a  decision  variable  xt .  Each  decision  variable  xt  is 
required  to  satisfy  a  set  of  tree  constraints  such  that  x±  <  x..  for  each  j  e 
P(i).  Let  x  be  a  |N|xl  vector  whose  i-th  entry  equals  x4 .  Then,  the  convex 
program  with  tree  constraints  can  be  formulated  as  : 


(P) 

Min  f(x) 

(1) 

st  xt  <  Xj 

for  j  6  P(i) 

and  for  each  i  e  N 

(2/ 

li  <  xi  < 

for  each 

i  e  N, 

where  f  is  assumed  to  be  continuous,  differentiable  and  strictly  convex  over 
N ^  .  Also,  1A  and  ut  are  the  lower  and  upper  bounds  on  each  decision 
variable  xi ;  respectively.  A  feasible  solution  to  problem  (P)  is  a  set  of 
xi's  that  satisfies  the  "box"  constraints  (2)  and  the  tree  constraints  (1). 
For  each  node  i,  let  A(i)  denote  the  set  of  predecessors  of  node  i.  Then  it 
is  easy  to  check  that  problem  (P)  is  feasible  if  and  only  if  lt  <  u^  for  each 
j  e  A(i)  and  for  each  i  e  N.  For  this  reason,  we  assume  that  li  <  u^  for  each 
j  e  A(i).  An  optimal  solution  to  problem  (P)  is  a  feasible  solution  with 
minimum  objective  value. 

Suppose  we  drop  the  tree  constraints  (1)  in  problem  (P).  Then  problem  is 
reduced  to  the  following  simple  convex  subproblem: 
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(S)  Min  f(x) 

st  1.  <  x.  <  u.  for  each  i  e  N. 

I  —  1—1  * 

Notice  that  Problem  (S)  is  a  simple  convex  program  with  the  "box"  constraints 
and  it  can  be  easily  solved  by  considering  the  first  order  condition  (c.f. 

Luenberger  (1984)).  The  simplicity  of  the  subproblem  (S)  motivates  a 
reduction  scheme,  which  is  described  as  follows. 

Suppose  we  solve  simple  convex  subproblem  (S) .  Let  y  denote  an  optimal 
solution  of  problem  (S) .  If  y  satisfies  all  the  tree  constraints,  then  y  is 
also  an  optimal  solution  to  problem  (P);  otherwise,  we  identify  a  pair  of 

« 

nodes  i  and  j ,  and  we  show  that  problem  (P)  will  have  an  optimal  solution  x 

such  that  x*^  -  x*±  .  In  the  latter  case,  since  x4  and  x^  have  the  same  • 

optimal  value,  we  can  replace  x^  by  xt  in  the  objective  function,  and  remove 

Xj  from  the  set  of  decision  variables.  Also,  we  update  the  remaining  tree  by 

setting  S(k)  -  i  for  each  node  k  e  P(j).  Hence,  the  number  of  decision 

variables  is  reduced  by  1  after  each  repetition  of  this  cycle,  and  hence,  a 

solution  to  problem  (P)  becomes  trivial  after  at  most  |N|  repetition  of  this 

cycle.  Notice  that  we  only  solve  the  "updated"  subproblem  (S)  in  each  cycle. 

Hence,  che  reduction  scheme  solves  problem  (P)  by  solving  at  most  |N|  simple 
convex  subproblems  (S) .  Hence,  problem  (P)  can  be  quickly  solved. 

To  our  knowledge,  problem  (P)  is  studied  for  the  first  time.  Geoffrion 
(1967)  examined  a  method  that  solves  general  convex  programs  with  linear 
constraints  by  solving  a  finite  sequence  of  subproblems.  This  paper  presents 
a  reduction  scheme  that  solves  problem  (P),  a  special  class  of  convex 
programs,  by  solving  at  most  |N|  simple  convex  subproblems. 

This  paper  is  organized  as  follows.  Section  2  discusses  the  applications 
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of  problem  (P) .  Section  3  presents  a  reduction  procedure  that  solves  problem 
(P)  by  solving  at  most  |'J|  simple  convex  subproblems  Section  4  concludes 
this  paper. 

2.  Applications  of  problem  (P) 

Consider  a  special  case  of  problem  (P)  in  which  the  objective  function 
f  is  separable.  Schwarz  and  Schrage  (1975)  discussed  the  applications  of 
problem  (P)  in  production  planning.  In  addition,  Willaims  (1982)  showed  the 
applications  of  problem  (P)  in  project  selection.  We  omit  the  details. 

When  f(x)  is  not  separable,  problem  (P)  has  different  applications  in 
production  planning,  capacity  planning,  and  quality  improvement.  These 
applications  are  now  described,  below. 

2.1  Dynamic  lot  sizes 

We  schedule  the  production  over  a  finite  planning  horizon  with  N 
periods.  At  each  period  i,  let  D1  denote  the  cumulative  demand  from  period  1 
to  period  i  and  let  xA  be  the  decision  variable  that  represents  the 
cumulative  production  volume  from  period  1  to  period  i.  (For  notational 
convenience,  let  xQ  —  0.)  Thus,  the  "actual"  production  volume  in  period  i 
is  (xA  -  xi.1),  for  i  -  1,...,  N.  Assume  that  the  demand  is  drawn  at  the  end 
of  each  period.  Then  (xt  *  Di )  represents  the  inventory  level  (backorder 
level)  at  the  end  of  period  i  when  (xA  -  DA )  is  positive  (negative).  The 
inventory  holding  cost/backorder  cost  of  carrying  units  at  period  i  is 
hi(zi).  The  production  cost  for  producing  zt  units  at  period  i  is  pJ(zi). 
Hence,  the  total  cost  incurred  at  period  i  can  be  rewritten  as  pA (xA  -  x1_1) 

+  hA (xi  -  Di ) .  To  determine  an  optimal  production  schedule  that  minimizes  the 
total  cost  incurred  over  the  planning  horizon,  we  formulate  the  following 


optimization  problem: 

(T)  Min  f(x)  -  2i  {pA (x±  -  x1.1)  +  ht  (xA  -  l>i)) 

(3)  st  0  -  x0  <  x,  <  ...  x,^  <  x±  ...  <  Xj,  +  1  -  D„. 

Note  that  constraints  (3)  ensures  that  the  cumulative  production  volume  is 
non-decreasing  over  time  and  it  guarantees  that  the  total  production  volume 
meets  the  total  demand  over  the  planning  horizon. 

Wagner  and  Whitin  (1957)  developed  the  celebrated  dynamic  lot  sizing 
model,  and  studied  a  different  formulation  of  problem  (T)  by  assuming  that 
the  cost  functions  pt ( . )  and  ht  ( . )  are  concave.  Zangwill  (1966)  extended  this 
model  to  the  case  of  backlogging. 

In  the  case  when  all  the  cost  functions  are  convex,  Veinott  (1966) 
suggested  an  interesting  approach  that  searches  negative  cycles  over  a 
network.  His  approach  is  not  efficient  for  solving  large  problem.  This 
observation  motivates  us  to  develop  an  efficient  approach  to  solve  problem 
(T) .  Since  problem  (T)  is  a  special  case  of  problem  (P) ,  it  suffices  to 
develop  an  efficient  approach  for  solving  problem  (P) . 

2.2  Capacity  planning 

It  is  noteworthy  to  mention  that  the  dynamic  lot-sizing  model  is  related 
to  capacity  planning  models  (c.f.  Luss(1982)).  To  see  that,  equate  the 
cumulative  production  volume  xA  with  capacity  level  at  period  i,  equate  the 
production  cost  pA  (xt  -  xi.1)  with  the  capacity  expansion  cost.  Also,  equate 
the  cumulative  demand  with  the  demand  required  at  period  i,  equate  the 
inventory  holding/backorder  cost  hA (xA  -  Di )  with  the  cost  of  carrying 
excessive  capacity/the  penalty  charge  of  operating  below  the  demand.  Hence, 
the  capacity  planning  problem  can  be  formulated  as  problem  (T) .  Because 
problem  (T)  is  a  special  case  of  problem  (P),  and  hence,  problem  (P)  could 
also  be  applied  to  capacity  planning  as  well  as  production  planning. 
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2.3  Quality  improvement 

Suppose  a  manufacturer  has  a  choice  to  select  the  quality  level  for  each 
of  the  N  periods.  Let  qi_1  be  the  quality  level  of  the  production  process 
during  period  i-1.  Then  the  decision  maker  selects  a  quality  level  qj^  at  the 
beginning  of  period  i.  Suppose  that  the  management  strives  for  good  quality 
and  desires  to  improve  the  quality  levels  over  time;  i.e.,  q1.1  <  qi  for  each 
i.  The  cost  associated  with  quality  improvement  during  period  i  is  I  (qt  - 
qi  _  j ) ,  where  I .  (  .  )  is  assumed  to  be  an  increasing  and  convex  function.  For 
any  quality  level  q. ,  the  demand  function  for  period  i  is  DL (qt ) ,  where  the 
demand  function  Di ( . )  is  assumed  to  be  increasing  and  concave.  Thus,  the 
demand  function  Di (qt )  is  rather  general  and  it  reflects  diminishing  returns 
in  demand  over  quality.  Let  pA  be  the  net  profit  per  unit  sold  during  time 
period  i,  where  pA  -  selling  price  at  period  i  -  material  cost  at  period  i. 
Hence,  the  net  profit  generated  in  period  i  is  PiDi(q1)-  There  is  a  cost 
Ci(qi)  for  maintaining  the  quality  level  at  qt  throughout  the  time  period  i. 
The  cost  Ci(qi)  consists  of  operating  cost,  machine  cost,  ...etc.  We  assume 
that  Ci(q1)  is  convex  and  increasing  in  qt .  Hence,  the  optimization  problem 
that  determines  optimal  quality  levels  over  time  can  be  formulated  as  the 
following  convex  program: 


<U) 

Min 

f(q> 

(4) 

st 

*i-i  £  ^ 

for  i  -  1, . . 

N, 

(5) 

%  <  1> 

where  f(q)  -  -  qi.l)  +  Ci  (qA )  -  piDi(qi)}  and  q0  represents  the 

initial  quality  level.  Since  I1(.)  and  CA ( . )  are  convex  and  since  DA ( . )  is 
concave,  f(q)  is  convex.  This  implies  that  problem  (U)  is  a  special  case  of 
problem  (P) ,  which  indicates  that  problem  (P)  has  application  in  quality 
improvement . 
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3.  Convex  program  with  tree  constraints  (P) 

This  section  presents  a  reduction  procedure  for  solving  problem  (P) . 
First,  notice  that  any  directed  tree  T  is  acyclic,  and  hence,  it  is  possible 
to  label  all  the  nodes  such  that  n  >  m  for  each  n  €  P(m) .  Second,  f  is 
strictly  convex,  and  therefore,  the  optimal  solution  to  subproblem  (S) , 
denoted  by  y,  is  unique.  If  y  satisfies  all  the  tree  constraints,  then  y  is 

also  an  optimal  solution  to  problem  (P) .  If  there  exists  some  nodes  such  that 

ym  >  yn ,  where  n  e  P(m),  then  we  can  designate  a  node  i  such  that  i  is  the 
largest  node  with  at  least  one  node  n,  where  n  e  P(i)  and  yi  >  yr •  Formally, 

(6)  i  -  max  {  m  e  N:  3  n  e  P(m),  ym  >  yn ) . 

Let  z  -  (z1 , . . . ,  zN )  be  the  optimal  solution  to  problem  (P) .  Clearly,  z 
satisfies  the  tree  constraints  while  y  does  not,  and  hence,  z  /  y  and  f(y)  < 
f(z).  The  following  proposition  relates  the  optimal  solution  z  to  node  i  and 
to  y,  where  y  is  the  optimal  solution  to  the  subproblem  (S) . 

Proposition  1  For  any  node  m  e  N,  zm  satisfies  all  of  the  following 
conditions : 

(7)  if  zm  <  zn  for  a  node  n  e  P(m) ,  then  zn  <  yn ; 

(8)  if  zm  <  zn  for  each  node  n  €  P(m) ,  then  zm  >  ym ;  and  moreover, 

(9)  if  m  -  i,  then  zn  >  yn  for  each  node  n  e  P(m) . 

Proof:  We  shall  prove  Proposition  1  by  contradiction.  Suppose  that  the 
optimal  solution  violates  at  least  one  of  the  conditions.  Then  it  is 
sufficient  to  consider  the  following  cases. 

(Case  a)  Suppose  that  z  violates  condition  (7).  Then  there  is  a  node  n  €  P(m) 
such  that  zm  <  zn  but  zn  >  yn .  In  that  case,  there  must  exist  a  S  such  that  6 
>  0,  zm  <  zn  -  6  and  zn  -  6  >  yn .  In  this  case,  let  z*  be  a  variant  of  the 


optimal  solution  z,  where  z*g  -  zg  for  s  /  n,  and  z*n  —  zn  -  yn .  Clearly, 

z*  can  be  expressed  as  a  convex  combination  of  z  and  y;  i.e.,  there  exists  a 
set  of  a  such  that  0  <  a  <1,  and  that  z*  -  a  z  +  (1-a  )y  for  n  - 
1,...,  | N |  .  Also,  it  is  easy  to  check  that  z*  is  a  feasible  solution  to 
Problem  (P) .  Combine  these  two  observations  with  the  fact  that  f(y)  <  f(z), 
and  that  f  is  strictly  convex,  we  can  conclude  that  f(z*)  <  f (z) ,  which 
contradicts  that  z  is  an  optimal  solution.  Hence,  this  case  cannot  happen. 
(Case  b)  Suppose  that  z  violates  condition  (8).  Then  zm  <  zn  for  each  node  n 
G  P(m),  but  z  <  y  .  In  this  case,  there  must  exist  a  5  such  that  5  >  0,  z  + 
6  <  z„  for  each  node  n  G  P(m)  and  z  +  S  <  y  .  Let  z*  be  a  variant  of 
solution  z,  where  z*g  -  zg  for  all  s  f  m  and  z*m  -  zm  +  8  <  ym .  By  applying 
the  same  argument  used  in  (a),  we  can  conclude  that  f(z*)  <  f (z) ,  which 
contradicts  that  z  is  an  optimal  solution.  Hence,  this  case  cannot  happen. 

(Case  c)  Suppose  that  z  violates  condition  (9).  Then  m  -  i  and  there  exists  a 

node  n  e  P(m)  such  that  zn  <  yn .  Let  J  denote  the  subset  of  A(i)  whose 
optimal  value  equals  zn .  Hence,  J  -  {  s  G  A(i):  zg  -  z„ } .  Notice  that  n  e  J 
and  that  for  any  node  s  G  J , 

(10)  zg  -  zn  <  zk  for  k  G  P(s)\J. 

It  follows  from  (6)  and  the  fact  that  s  >  i  for  each  s  G  J,  where  J  c  A(i), 
it  is  easy  to  see  that  yn  <  yg .  This  implies  that 

(11)  Zg  —  zn  <  yn  <  yg  for  each  s  G  J. 

It  follows  from  (10)  and  (11),  there  must  exist  a  S  such  that  6  >  0,  and  that 
2»  +  &  <  ys  for  each  s  G  J,  and 

z»  +  6  5  zk  f°r  each  s  G  J  and  for  each  k  e  P(s)\J. 

Let  z*  be  a  variant  of  solution  z,  where  z*g  -  zg  for  all  s  £  J  and  z*g  -  zg 
+  S  for  each  s  G  J.  For  each  node  s  G  J,  it  is  easy  to  see  that 
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for  k  ^  J  and  k  -  S(s) , 


z*s  -  zs  +  5  >  zg  >  zk  -  z\ 


z*s  -zs+6-zk+5  -  z*k 


z*5  -  zs  +  8  <  zk  -  z*k 


z*s  -  +  8  -  z k  +  6  -  z*k 


z*s  “  zs  +  ^  <  ys  <  us 


z*s  “  zs  +  8  >  z»  >  1» 


These  observations  imply  that  z*  is  also  a 
same  argument  used  in  (a) ,  we  can  conclude 
contradicts  that  z  is  an  optimal  solution, 
completes  the  proof.  || 


for  k  e  J  and  k  -  S(s), 
for  each  k  €  P(s)\J, 
for  each  k  e  P(s)r\J, 
for  each  s  e  J ,  and 
for  each  s  e  J. 

feasible  solution.  By  applying  the 

that  f(z*)  <  f(z),  which 

This  case  cannot  happen,  which 


Given  node  i,  as  defined  in  equation  (6),  we  designate  a  node  j  such 
that  y  has  the  smallest  value  among  all  predecessors  in  P(i).  More  formally, 

(12)  j  -  argminl  yn :  n  €  P(i)} 

It  follows  from  the  definition  of  node  i  in  (6),  there  must  exist  a  node  n 
such  that  n  e  P(i)  and  yt  >  yn .  Combine  this  observation  with  the  definition 
of  j  in  (12),  we  can  conclude 

(13)  Yt  >  yn  >  Yj  • 

The  conditions  (7),  (8),  and  (9)  stated  in  Proposition  1  and  (13)  enable  us 
to  establish  a  special  relationship  between  zi  and  that  is  considered  in 
♦•he  following  Proposition. 


Proposition  2  The  optimal  solution  z  has  this  property:  Zj  -  zi  . 

Proof:  It  follows  from  the  assumption  on  the  bounds,  as  stated  in  section  1, 
14  <  un  for  each  n  e  A(i).  Because  j  e  P(i)cA(i)  and  lj  <  un  for  n  €  A(i), 
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(U)  1,  <  Uj  . 

It  follows  from  (13),  the  fact  that  ui  >  yi ,  and  the  fact  that  jr  >  1  ,  we 
have 

(15)  ^  <  Yj  <  y4  <  u4 . 

Combine  ^1 4;,  (15)  and  the  fact  that  li  <  and  the  fact  that  1^  <  ir  ,  we 
conclude  that 

(16)  max  (li ,  1  )  <  min  {ut ,  ) . 

Hence,  there  must  exist  a  feasible  solution  x  to  problem  (P)  such  that  1  < 

x  <  u  ,  1  <  x  <  u  ,  and  x  -  x  .  It  remains  to  show  that  the  optimal 
solution  z  has  z -  .  Suppose  that  zi  /  z. .  Since  z  satisfies  the  tree 

constraints  and  since  j  6  P(i), 

(17)  z.  <  V 

In  this  case,  condition  (7)  implies  that 

(18)  zj  -  Yj  • 

In  addition,  condition  (9)  implies  that 

(19)  yn  <  zn  for  each  n  €  P(i) . 

It  follow  from  the  definition  of  j  in  (12), 

(20)  y.  <  yn  for  each  n  e  P(i). 

Combining  (19),  (20),  (18)  with  (17),  we  have 

(21)  zn  >  yn  >  Yj  >  Zj  >  zl  for  each  n  e  P(i). 

It  follows  from  (21)  and  condition  (8), 

(22)  zi  >  yi  . 

Combine  (22),  (13)  and  (18),  we  can  conclude  that 

(23)  z,  >  Yi  >  Yj  >  zj  • 

Hence,  zi  >  Zj  ,  which  contradicts  (17).  This  completes  the  proof.  || 
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We  now  apply  Proposition  2  to  construct  a  reduction  procedure.  Suppose 
we  compute  y  by  solving  problem  (S) .  If  y  satisfies  all  the  tree  constraints, 
then  y  is  also  an  optimal  solution  to  problem  (P) .  If  y  violates  some  of  the 
constraints,  then  we  determine  a  specific  node  i  and  a  specific  node  j  such 
that  Zj  -  zi  .  In  the  latter  case,  we  reduce  the  set  of  decision  variables  Z 
by  setting  Z  =  Z  \  j ,  update  the  objective  function  by  replacing  x^  by  xd , 
replace  li  by  Max  {  1± ,  1^  } ,  and  replace  uf  by  Min  (ui ,  u^  } .  We  update  the 

remaining  tree  by  setting  S(k)  -  i  for  each  k  6  P ( j ) .  This  allows  us  to  start 
the  next  cycle.  Hence,  an  optimal  solution  to  problem  (P)  can  be  found  within 
| N |  cycles.  Let  Z  be  the  current  set  of  decision  variables . Table  I,  below, 
presents  the  reduction  procedure  that  solves  problem  (P)  by  solving  at  most 
| N j  simple  convex  subproblems. 

Reduction  Procedure 

Step  1:  Set  X  -  N. 

Step  2:  [Optimality]  Compute  yk  for  each  k  e  Z.  If  yk  <  yt  for  1  e  F(k) 
and  for  each  k,  set  zk  -  yk  for  each  k  e  Z  and  STOP; 
otherwise,  continue. 

Step  3:  [Reduction]  Compute  i  and  j.  Replace  x^  by  in  the  objective 
function,  set  1A  -  Max  ( li  ,  1^  > ,  set  ui  -  Min  (  u.  ,  u^ } ,  and 
replace  Z  by  X\j  Also,  set  S(k)  -  i  for  each  k  6  P(j). 

GOTO  Step  2. 

Table  I 

At  each  iteration,  the  reduction  procedure  either  stops  and  finds  an  optimal 
solution  in  Step  2  or  it  reduces  the  number  of  decision  variables  by  one  in 
Step  3.  Thus,  the  reduction  procedure  stops  within  |N|  iterations.  We  solve 
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only  one  convex  subproblem  (S)  in  Step  2.  Hence,  the  reduction  procedure 

*  solves  problem  (P)  by  solving  at  most  simple  convex  subproblems. 

4.  Concluding  Remarks 

■? 

Throughout  this  paper,  we  assumed  that  f  i continuous  and 
differentiable.  This  assumption  guarantees  that  the  first  order  condition  can 
be  easily  obtained,  and  hence,  problem  (S)  can  be  quickly  solved.  In 
addition,  we  assumed  that  f  is  strictly  convex.  This  assumption  provides 
computational  advantages  for  computing  the  unique  optimal  solutions  of 
problem  (P)  and  of  its  subproblem  (S) .  It  can  be  shown,  however,  that  the 
reduction  procedure  can  be  adapted  to  the  case  when  f  is  not  strictly  convex. 
In  that  case,  the  "adapted"  reduction  procedure  would  not  be  efficient 

*  because  of  two  reasons.  First,  when  f  is  not  strictly  convex,  the  set  of 

,  optimal  solutions  to  problem  (S)  is  a  convex  set  C,  say,  which  may  not  have  a 

simple  characterization.  Second,  given  the  set  C,  it  is  not  easy  to  check 
whether  there  exists  an  optimal  solution  y  e  C  such  that  y  satisfies  all  the 
tree  constraints. 

In  sum,  we  presented  a  class  of  separable  convex  programs  with  tree 
constraints  that  has  applications  in  production  planning,  capacity  planning, 
quality  improvement  and  other  related  areas.  By  exploring  some  special 
properties  of  the  optimal  solution  to  problem  (?) ,  we  developed  a  reduction 
procedure  that  solves  problem  (P)  by  solving  at  most  |N|  simple  convex 
subproblems,  and  hence,  problem  (P)  can  be  quickly  solved.  Therefore,  this 
reduction  procedure  is  efficient  for  solving  large  convex  programs  of  this 
sort.  As  a  future  research  direction,  we  shall  examine  the  case  when  the 

t  constraints  are  more  general  than  the  tree  constraints;  for  instance,  network 

constraints . 
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